SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT WE, Takahiro Aoki , a 
citizen of Japan residing at Kawasaki, Japan and Morito 
Shiohara, a citizen of Japan residing at Kawasaki, Japan 
have invented certain new and useful improvements in 

IMAGE EXTRACTION METHOD AND 
AUTHENTICATION APPARATUS 

Of which the following is a specification:- 



TITLE OF THE INVENTION 

IMAGE EXTRACTION METHOD AND AUTHENTICATION 
APPARATUS 

BACKGROUND OF THE INVENTION 

This application claims the benefit of a 
Japanese Patent Application No . 2 0 02-2 55 922 filed 
August 30, 2002, in the Japanese Patent Office, the 
disclosure of which is hereby incorporated by 
reference. 

1. Field of the Invention 

The present invention generally relates to 
image extraction methods and authentication 
apparatuses, and more particularly to an image 
extraction method which is suited for extracting an 
object such as a person from an image which is 
picked up by removing the background, and to an 
authentication apparatus which uses such an image 
extraction method . 

2. Description of the Related Art 

In image processing such as an image 
combining process and a personal authentication 
process, an extraction of an object such as a person 
from an image is frequently carried out. For 
example, as a method of extracting only the person 
by removing the background from the image which is 
picked up, there is a method which uses a blue 
background. The human body does not include the 
blue color. For this reason, when the image of a 
person is picked up using the blue background and 
the blue region is removed from the picked up image, 
it is possible to remove the background from the 
picked up image and extract the person's face or the 
like from the picked up image. 

However, the method using the blue 
background employs an image separation method based 
on color, and can only be used under visible light. 
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Still another object of the present 
invention is to provide an image extraction method 
comprising a first image pickup step to pick up an 
image of an object positioned in front of a 
background using wavelengths in a visible light 
region; a second image pickup step to pick up an 
image of the object positioned in front of the 
background using wavelengths in an infrared region; 
and an extracting step to extract only the object 
based on the images picked up by the first and 
second image pickup steps, wherein at least a 
surface of the background is formed by an organic 
dye. According to the image extraction method of 
the present invention, it is possible to extract the 
object from the picked up image with a high accuracy 
using a relatively simple process and structure. 

A further object of the present invention 
is to provide an authentication apparatus comprising 
a first image pickup section to pick up an image of 
an object positioned in front of a background using 
wavelengths in a visible light region; a second 
image pickup section to pick up an image of the 
object positioned in front of the background using 
wavelengths in an infrared region; an extracting 
section to extract only an image of the object based 
on the images picked up by the first and second 
image pickup sections; and a matching section to 
compare the image extracted by the extracting 
section and registered object images, and to output 
a result of comparison as an authentication result, 
wherein at least a surface of the background is 
formed by an organic dye. According to the 
authentication apparatus of the present invention, 
it is possible to extract the object from the picked 
up image with a high accuracy, using a relatively 
simple process and structure. 

Other objects and further features of the 
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present invention will be apparent from the 
following detailed description when read in 
conjunction with the accompanying drawings. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram for explaining a first 
embodiment of an image extraction method according 
to the present invention; 

FIGS. 2A and 2B are diagrams for 
10 explaining an image extraction from an image picked 
up by a visible light camera; 

FIGS. 3A and 3B are diagrams for 
explaining an image extraction from an image picked 
up by an infrared camera; 
15 FIG. 4 is a system block diagram showing a 

first embodiment of an authentication apparatus 
according to the present invention; 

FIG. 5 is a flow chart for explaining a 
cut out process; and 
20 FIG. 6 is a flow chart for explaining a 

matching process. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A description will be given of various 

25 embodiments of an image extraction method and an 
authentication apparatus according to the present 
invention, by referring to the drawings. 

First, a description will be given of a 
first embodiment of the image extraction method 

30 according to the present invention, by referring to 
FIGS. 1 through 3B. FIG. 1 is a diagram for 
explaining this first embodiment of the image 
extraction method according to the- present invention. 
FIGS. 2A and 2B are diagrams for explaining an image 

35 extraction from an image picked up by a visible 

light camera, and FIGS. 3A and 3B are diagrams for 
explaining an image extraction from an image picked 
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kind of organic dye which is coated on the surface 
of the background 2 depending on the color of the 
target object. 

On the other hand, the organic dye has a 
5 characteristic which absorbs the infrared ray, and 

particularly the near-infrared ray. This is because, 
a wavelength of a laser beam used for the signal 
recording and/or reproduction on and/or from the CD- 
R or the like is approximately 800 nm, and the 

10 organic dye used for the recording layer of the CD-R 
or the like is designed to absorb the infrared ray 
having wavelengths in a vicinity of the wavelength 
of the laser beam. Accordingly, when the organic 
dye is picked up by the infrared camera 12 in the 

15 wavelengths of the infrared region, the organic dye 
appears to be black because the organic dye absorbs 
the infrared ray. For this reason, when the surface 
of the background 2 is coated with the cyanine 
organic dye and the object 1 in front of the 

20 background is picked up by the infrared camera 12 in 
the wavelengths of the infrared region, the 
background 2 appears black or dark in the picked up 
image, and the object 1 can be extracted by cutting 
out the black or dark portion from the picked up 

25 image. 

FIG. 2A shows the image which is picked up 
by the visible light camera 11. In this picked up 
image, an image portion 102-1 corresponding to the 
background 2 has a blue-green color with respect to 

30 an image portion 101-1 corresponding to the object 1. 
Hence, by cutting out the blue-green image portion 
102-1 similarly to the case where the blue 
background is used, based on the color of the image 
portion 102-1, it is possible to extract the image 

35 portion 101-1 of the object 1 as shown in FIG. 2B. 

FIG. 3A shows the image which is picked up 
by the infrared camera 12. In this picked up image, 
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embodiment of the image extraction method. In this 
embodiment, it is assumed for the sake of 
convenience that the authentication apparatus is 
used to restrict entry into a room. 
5 FIG. 4 is a system block diagram showing 

the first embodiment of the authentication apparatus. 
In FIG. 4, those parts which are the same as those 
corresponding parts in FIG. 1 are designated by the 
same reference numerals, and a description thereof 

10 will be omitted. The authentication apparatus shown 
in FIG. 4 includes the visible light camera 11, the 
infrared camera 12, a visible light illumination 21, 
an infrared illumination 22, background cut out 
sections 31 and 32, a matching section 33, a door 

15 key 34, and a personal information database 35. 

The visible light illumination 21 is 
turned ON if necessary so as to obtain an 
illumination environment suited for picking up the 
image of the object 1 by the visible light camera 11. 

20 The infrared illumination 22 is turned ON if 
necessary so as to obtain an illumination 
environment suited for picking up the image of the 
object 1 by the infrared camera 12. The visible 
light illumination 21 and/or the infrared 

25 illumination 22 may be omitted. 

The background cut out section 31 cuts out 
the image portion 102-1 corresponding to the 
background 2 based on the color, from the image 
shown in FIG. 2A which is picked up by the visible 

30 light camera 11, so as to extract the image portion 

101-1 corresponding to the object 1 shown in FIG. 2B. 
The background cut out section 32 cuts out the image 
portion 102-2 corresponding to the background 2 
based on the brightness, from the image shown in FIG. 

35 3A which is picked up by the infrared camera 12, so 
as to extract the image portion 101-2 corresponding 
to the object 1 shown in FIG. 3B. The extracted 



image portion 101-1 from the background cut out 
section 31 and the extracted image portion 101-2 
from the background cut out section 32 are supplied 
to the matching section 33. 

The matching section 33 decides whether or 
not one of the image portions 101-1 and 101-2 
supplied from the background cut out sections 31 and 

32 matches a reference image portion which is 
registered in the personal information database 35, 
so as to judge whether or not the object 1 is a user 
who is registered in advance in the personal 
information database 35. When the matching section 

33 judges that a matching reference image portion is 
not registered in the personal information database 
35, the matching section 33 records the image 
portions 101-1 and 101-2 supplied from the 
background cut out sections 31 and 32 as logs. In 
this case, the door key 34 is locked, and the user 
is not permitted to enter the room. On the other 
hand, when the matching section 33 judges that a 
matching reference image portion is registered in 
the personal information database 35, the matching 
section 33 supplies a match signal to the door key 
34. The door key 34 is opened in response to the 
match signal, and the user is thus permitted to 
enter the room. 

The personal information database 35 may 
be a part of the authentication apparatus or, an 
external database which is accessible from the 
authentication apparatus . 

The background cut out sections 31 and 32 
and the matching section 33 may be realized by a 
central processing unit (CPU) of a general purpose 
computer system. 

Of course, when the matching section 33 
judges that a matching reference image portion is 
not registered in the personal information database 



-11- 



35, the matching section 33 may supply a 
disagreement signal to the door key 34. In this 
case, it is possible to turn ON a lamp which is 
connected to the door key 34 or, display a message 
5 on a display section, in response to the match 
signal and/or the disagreement signal, so as to 
indicate that the user is permitted to enter the 
room and/or is not permitted to enter the room. 

The authentication apparatus is not 

10 limited to the application to restrict entry to the 
room. For example, the authentication apparatus may 
be applied to a computer system so as to restrict 
the use of the computer system. In this case, the 
match signal and/or the disagreement output from the 

15 matching section 33 may be used to trigger an access 
restriction of the computer system, a display of 
access enabled state of the computer system, a 
display of access disabled state of the computer 
system, and the like. 

20 FIG. 5 is a flow chart for explaining a 

cur out process of the background cut out section 32. 
In FIG. 5, a step SI decides whether or not all 
pixels within the image shown in FIG. 3A which is 
supplied from the infrared camera 12 are evaluated, 

25 and the process ends if the decision result in the 
step SI is YES. On the other hand, if the decision 
result in the step SI is NO, a step S2 decides 
whether or not a luminance of a target pixel within 
the image is less than or equal to a predetermined 

30 threshold value Th. If the decision result in the 
step S2 is NO, a step S3 judges that the target 
pixel is not the image portion 102-2 corresponding 
to the background 2, and the process advances to a 
step S5 which will be described later. If the 

35 decision result in the step S2 is YES, a step S4 
judges that the target pixel is the image portion 
102-2 corresponding to the background 2, and the 
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process advances to the step S5. 

The step S5 investigates a next pixel 
within the image, and the process returns to the 
step SI. If the decision result in the step SI is 
5 NO, the step S2 and the subsequent steps are carried 
out by regarding the next pixel as the target pixel. 

The cut out process itself of the 
background cut out section 31 can be carried out by 
a known method, and a description thereof will be 

10 omitted. The background cut out section 31 can 

carry out a process similar to that shown in FIG. 5, 
for example, with respect to the image shown in FIG. 
2A which is supplied from the visible light camera 
11. In this case, however, a step corresponding to 

15 the step S2 decides whether or not the color of the 
target pixel is a predetermined color (blue-green 
color in this particular case) , instead of deciding 
whether or not the luminance of the target pixel is 
less than or equal to the predetermined threshold 

20 value Th. 

FIG. 6 is a flow chart for explaining a 
matching process of the matching section 33. In FIG. 
6, steps Sll through S15 which are carried out with 
respect to the image data of the image portion 101-1 

25 corresponding to the object and supplied from the 
visible light camera 11, and steps S21 through 25 
which are carried out with respect to the image data 
of the image portion 101-2 corresponding to the 
object 1 and supplied from the infrared camera 12, 

30 are carried out in parallel. 

The step Sll inputs the image data of the 
image portion 101-1 corresponding to the object 1 
supplied from the visible light camera 11, and the 
step S12 carries out a known noise reduction process 

35 with respect to the input image data. The step S13 
converts the image data obtained by the step S12 
into a vector. In addition, the step S14 acquires a 
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vector of the image data corresponding to a 
registered reference image portion which matches the 
input image data and is read from the personal 
information database 35. The registered reference 
5 image portion which matches the input image data and 
is read from the personal information database 35 
need not perfectly match the input image data, and 
may match the input image data within a 
predetermined (or tolerable) range. The step S15 

10 calculates a distance LI between the vector obtained 
by the step S13 and the vector obtained by the step 
S14, and the process advances to a step S36 which 
will be described later. 

On the other hand, the step S21 inputs the 

15 image data of the image portion 101-2 corresponding 

to the object 1 supplied from the infrared camera 12, 
and the step S22 carries out a known noise reduction 
process with respect to the input image data. The 
step S23 converts the image data obtained by the 

20 step S22 into a vector. In addition, the step S24 

acquires a vector of the image data corresponding to 
a registered reference image portion which matches 
the input image data and is read from the personal 
information database 35. The registered reference 

25 image portion which matches the input image data and 
is read from the personal information database 35 
need not perfectly match the input image data, and 
may match the input image data within a 
predetermined (or tolerable) range. The step S25 

30 calculates a distance L2 between the vector obtained 
by the step S23 and the vector obtained by the step 
S24, and the process advances to the step S36 which 
will be described later. 

The vector of the image data corresponding 

35 to the registered reference image portion may be 
stored in the personal information database 35. 
Alternatively, the image data corresponding to the 
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registered reference image portion may be stored in 
the personal information database 35, and this image 
data read from the personal information database 35 
may be converted into a vector in the steps S14 and 
5 S24, similarly to the steps S13 and S23. 

The step S36 calculates an average Lav of 
the distance LI calculated in the step S15 and the 
distance L2 calculated in the step S25. A step S37 
decides whether or not the average Lav is greater 

10 than or equal to a threshold value Thl . If the 

decision result in the step S37 is NO, a step S38 
judges that the object 1 is not the registered user 
who is registered in advance in the personal 
information database 35, outputs the disagreement 

15 signal described above if necessary, and the process 
ends. On the other hand, if the decision result in 
the step S37 is YES, a step S39 judges that the 
object 1 is the registered user who is registered in 
advance in the personal information database 35, 

20 outputs the match signal described above, and the 
process ends. 

By changing the color of the background 2 
depending on the image which is to be picked up and 
the object 1 which is to be extracted from the 

25 picked up image, it is possible to extract the 

object 1 from the image which is picked up by the 
visible light camera 11 by the background cut out 
section 31 using a known method. Hence, by forming 
at least the surface of the background 2 by the 

30 organic dye having an appropriate color, it is 

possible to similarly extract the object 1 from the 
image which is picked up by the infrared camera 12 
by the background cut out section 32 using the 
method described above. 

35 Therefore, according to the present 

invention, it is possible to simultaneously pick up 
the image of the object in two different wavelengths, 
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namely, the wavelengths of the visible light region 
and the wavelengths of the infrared region. For 
this reason, it is possible to extract only the 
object from the picked up image with a high accuracy 
Moreover, since it is possible to utilize the two 
different wavelengths, namely, the wavelengths of 
the visible light region and the wavelengths of the 
infrared region, it is possible to improve the 
reliability of the authentication apparatus by 
applying the present invention to the authentication 
apparatus . 

Further, the present invention is not 
limited to these embodiments, but various variations 
and modifications may be made without departing from 
the scope of the present invention. 



